5 Turing and the computer 

B. Jack Copeland and Diane Proudfoot 


The Turing machine 

In his first major publication, ‘On computable numbers, with an application 
to the Entscheidungsproblem’ (1936), Turing introduced his abstract Turing 
machines. 1 (Turing referred to these simply as ‘computing machines’— 
the American logician Alonzo Church dubbed them ‘Turing machines’. 2 ) 
'On Computable Numbers’ pioneered the idea essential to the modern 
computer—the concept of controlling a computing machine’s operations by 
means of a program of coded instructions stored in the machine’s memory. 
This work had a profound influence on the development in the 1940s of the 
electronic stored-program digital computer—an influence often neglected or 
denied by historians of the computer. 

A Turing machine is an abstract conceptual model. It consists of a scanner 
and a limitless memory-tape. The tape is divided into squares, each of which 
may be blank or may bear a single symbol (‘o’ or ‘1’, for example, or some 
other symbol taken from a finite alphabet). The scanner moves back and forth 
through the memory, examining one square at a time (the ‘scanned square’). 
It reads the symbols on the tape and writes further symbols. The tape is both 
the memory and the vehicle for input and output. The tape may also contain 
a program of instructions. (Although the tape itself is limitless—Turing's aim 
was to show that there are tasks that Turing machines cannot perform, even 
given unlimited working memory and unlimited time—any input inscribed 
on the tape must consist of a finite number of symbols.) 

A Turing machine has a small repertoire of basic operations: move left one 
square, move right one square, print, and change state. Movement is always 
by one square at a time. The scanner can print a symbol on the scanned 
square (after erasing any existing symbol). By changing its state the machine 
can (as Turing put it) ‘remember some of the symbols which it has “seen” 
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(scanned) previously’. 3 Turing did not specify a mechanism for changing 
state (Turing machines are abstractions and proposing a specific mechanism 
is unnecessary) but one can easily be imagined. Suppose that a device within 
the scanner consists of a dial with a finite number of positions, labelled ‘a’, 
b'. ‘c’, and so on, each position counting as a different state. Changing state 
consists in shifting the dial’s pointer from one labelled position to another. 
This device functions as a simple memory; for example, a dial with three 
positions can be used to record whether the square that the scanner has just 
vacated contained ‘o’ or ‘i’, or was blank. 

The operation of the machine is governed by (what Turing called) a table 
of instructions. He gave the following simple example. 4 A machine—call it 
M—begins work with an endless blank tape and with the scanner positioned 
over any square of the tape. M has four states, labelled ‘a’, 'b', ‘c’, and 'd\ 
and is in state a when it starts work. In the table below, ‘R’ is an abbreviation 
of the instruction ‘move right one square’, l P[o]' is an abbreviation of ‘print 
o on the scanned square’, and analogously ‘P[i]’. The top line of the table 
reads: if you are in state a and the square you are scanning is blank, then 
print o on the scanned square, move right one square, and go into state b. 


State 

Scanned square 

Operations 

Next state 

a 

Blank 

P[o], R 

b 

b 

Blank 

R 

c 

c 

Blank 

P[i],R 

d 

d 

Blank 

R 

a 


Acting in accordance with this I able of instructions—or program—M prints 
alternating binary digits on the tape, oioioi..., working endlessly to the 
right from its starting place, leaving a blank square in between each digit. 

The universal Turing machine (UTM) 

The UTM is universal in that it can be programmed to carry out any calcu¬ 
lation that could in principle be performed by a 'human computer’—a clerk 
who works by rote and has unlimited time and an endless supply of paper 
and pencils. (Before the advent of the electronic computer, many thousands 
of human computers were employed in business, government, and research 
establishments.) 
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The universal machine has a single, fixed table of instructions built into 
it (‘hard-wired’, so to speak, into the machine). Operating in accordance 
with this one fixed table, the UTM can read and execute coded instructions 
inscribed on its tape. This ingenious idea—the concept of controlling the 
function of the computing machine by storing a program of instructions in 
the machine’s memory—is fundamental to computer science. An instruc¬ 
tion table for carrying out a desired task is placed on the machine’s tape in 
a suitably encoded form, the first line of the table occupying the first so many 
squares of the tape, the second line the next so many squares, and so on. 
The UTM reads the instructions and carries them out on its tape. Different 
programs can be inscribed on the tape, enabling the UTM to carry out any task 
for which a Turing-machine instruction table can be written—thus a single 
machine of fixed structure is able to carry out every computation that can be 
carried out by any Turing machine whatsoever. 

In 1936 the UTM existed only as an idea. But right from the start Turing 
was interested in the possibility of actually building such a machine. 5 His 
wartime acquaintance with electronics was the key link between his earlier 
theoretical work and his 1945 design for an electronic stored-program digital 
computer. 

The Church-Turing thesis 

The Church-Turing thesis (also known simply as ‘Church’s thesis’ 
and ‘Turing’s thesis’) played a pivotal role in Turing’s argument 
(in 'On Computable Numbers’) that there are well-defined mathematical tasks 
that cannot be carried out by a rote method or algorithm. 6 One of Turing’s 
most accessible formulations of the Church-Turing thesis is found in a report 
written in 1948, ‘Intelligent Machinery': 

LCMs [Turing machines] can do anything that could be described as 
‘rule of thumb' or ‘purely mechanical '. 7 

Turing remarked: 

This is sufficiently well established that it is now agreed amongst 
logicians that ‘calculable by means of an LCM’ is the correct accurate 
rendering of such phrases . 8 

In ‘On Computable Numbers’, having proved that there are tasks the univer¬ 
sal Turing machine cannot carry out (even given unlimited time and tape), 
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Turing appealed to the Church-Turing thesis in moving to the conclusion that 
there are tasks that cannot be accomplished by means of any rote method. 

The Church-Turing thesis is sometimes said to state the ‘limits of 
machines’. 9 For example, Newell asserted: 

That there exists a most general formulation of machine and that it 

leads to a unique set of input-output functions has come to be called 

Church’s thesis. 0 

However, this goes well beyond anything that Turing and Church said them¬ 
selves. Turing’s concern was not to give ‘a most general formulation of 
machine’, but to state the limits of what can be accomplished by a human 
being working by rote. Turing, like Church, aimed to show that some well- 
defined tasks cannot be carried out by a human being working in this way; 
it does not follow from this (and nor did they claim that it does) that there 
are no machines able to carry out these tasks. 11 

Cryptanalytic machines 

Turing completed the logical design of the famous Bombe—built to break 
German Enigma messages—in the last months of 1939. 12 His designs 
were handed over to Keen at the British Tabulating Machine Company in 
Letchworth, where the engineering development was carried out. 11 The 
first Bombe, named ‘Victory’, was installed at the Government Code and 
Cypher School (GC & CS) at Bletchley Park early in 1940. 14 (An improved 
model—Agnus', short for Agnus Dei', but later corrupted to Agnes’ 
and Aggie’—which contained Welchman's ingenious diagonal board was 
installed some months later. 15 ) The Bombe was a ‘computing machine’— 
a term for any machine able to do work that could be done by a human 
computer—but one with a very narrow and specialized purpose, namely 
searching through the wheel-positions of the Enigma machine, at super¬ 
human speed, in order to find the positions at which a German message had 
been encrypted. The Bombe produced likely candidates, which were tested 
by hand on an Enigma machine (or a replica of one)—if German emerged 
(even a few words followed by nonsense), the candidate settings were the right 
ones. The Bombe was based on the electromagnetic relay, although some later 
versions were electronic (i.e. valve-based) and in consequence faster. Relays 
are small switches consisting of a moving metal rod—which opens and closes 
an electrical circuit—and an electrical coil, the magnetic field of which moves 
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the rod. Electronic valves, called ‘vacuum tubes’ in the United States, operate 
very many times faster than relays, as the valve’s only moving part is a beam 
of electrons. 

During the attack on Enigma, Bletchley Park approached the Post Office 
Research Station at Dollis Hill in London to build a relay-based machine 
for use in conjunction with the Bombe. Once the Bombe had uncovered 
the Enigma settings for a given day, these settings were to be transferred to 
the proposed machine, which would then decipher messages and print out the 
original German text. 16 Dollis Hill sent electronic engineer Thomas Flowers to 
Bletchley Park, fn the end, the machine Flowers built was not used, but he was 
soon to become one of the great figures of Second World War codebreaking. 
Thanks to his pre-war research, Flowers was (as he himself remarked) possibly 
the only person in Britain who realized that valves could be used on a large 
scale for high-speed digital computing. 17 

The world's first large-scale electronic digital computer, Colossus, was 
designed and built during 1943 by Flowers and his team at Dollis Hill, in 
consultation with the Cambridge mathematician Max Newman, head of the 
section at Bletchley Park known simply as the ‘Newmanry’. (Turing attended 
Newman’s lectures on mathematical logic at Cambridge before the war; these 
lectures launched Turing on the research that led to his ‘On Computable 
Numbers’. 18 ) Colossus first worked in December 194 5 19 (exactly two years 
before the first comparable US machine, the ENIAC, was operational 20 ). 
Colossus was used against the Lorenz cipher machine, more advanced than 
Enigma and introduced in 1941. 21 The British government kept Colossus 
secret; before the 1970s few had any idea that electronic computation had 
been used successfully during the Second World War, and it was not until 
2000 that Britain and the United States finally declassified the complete 
account of Colossus' wartime role. 22 So it was that, in the decades following 
the war, John von Neumann and others told the world that the ENIAC was 
‘the first electronic computing machine’. 21 

Although Colossus possessed a certain amount of flexibility, it was very far 
from universal. Nor did it store instructions internally. As with the ENIAC, 
in order to set Colossus up for a new job it was necessary to modify by hand 
some of the machine’s wiring, by means of switches and plugs. (During the 
construction of Colossus, Newman showed Flowers Turing’s ‘On Computable 
Numbers’, with its key idea of storing coded instructions in memory, but 
Flowers, not being a mathematical logician, ‘didn’t really understand much 
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of it’ , 24 ) Nevertheless, Flowers established decisively and for the first time that 
large-scale electronic computing machinery was practicable. 

Flowers said that, once Turing saw Colossus in operation, it was just 
a matter of Turing’s waiting to see what opportunity might arise to put 
the idea of his universal computing machine into practice. 25 There is little 
doubt that by 1944 Newman too had firmly in mind the possibility of build¬ 
ing a universal machine using electronic technology. In February 1946, a few 
months after his appointment as Professor of Mathematics at the University 
of Manchester, Newman wrote to von Neumann in the United States: 

I am ... hoping to embark on a computing machine section here, 
having got very interested in electronic devices of this kind during the 
last two or three years. By about eighteen months ago I had decided 
to try my hand at starting up a machine unit when I got out. ... I am 
of course in close touch with Turing . 26 

Turing's own opportunity came when Womersley appeared out of the blue 
to recruit him to the National Physical Laboratory (see Chapter 3). By then 
Turing had educated himself in electronic engineering (during the later part 
of the war he gave a series of evening lectures ‘on valve theory’). 2/ 


The ACE and the EDVAC 

In the years immediately following the Second World War, the Hungarian 
American logician and mathematician John von Neumann, through writings 
and charismatic public addresses, made the concept of the stored-program 
digital computer widely known. Von Neumann wrote ‘First Draft of a Report 
on the EDVAC’ (see the Introduction) and subsequently directed the computer 
project at the Princeton Institute for Advanced Study. The ensuing machine, 
the IAS computer, although not the first to run in the United States (it began 
work in the summer of 1951 28 ), was the most influential of the early US com¬ 
puters and the precursor to the IBM 701, the company’s first mass-produced 
stored-program electronic computer. 

Von Neumann’s ‘First Draft of a Report on the EDVAC’ was widely read 
and was used as a blueprint by. among others, Wilkes, whose EDSAC at the 
University of Cambridge was the second stored-program electronic computer 
to function (in 1949). Turing certainly expected his readers to be familiar 
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with the ‘First Draft’. At the end of the first section of ‘Proposed Electronic 
Calculator’ he said: 

The present report gives a fairly complete account of the proposed 
calculator. It is recommended however that it be read in conjunction 
with J. von Neumann’s ‘[First Draft of a] Report on the EDVAC’. 

To what extent was the content of ‘Proposed Electronic Calculator' influ¬ 
enced by the ‘First Draft’? The former follows von Neumann’s terminology 
and notation to some extent. This decision was a sensible one in the cir¬ 
cumstances, making it likely that Turing’s report would be more readily 
understood. In order to depict the EDVAC’s logic gates, von Neumann had 
used a modified version of a diagrammatic notation introduced by McCulloch 
and Pitts in connection with neural nets. 29 Turing adopted this modified 
notation and in fact considerably extended it. 30 There is no doubt that Turing 
simply borrowed some of the more elementary material from the ‘First Draft’. 
(For example, his diagram of an adder—figure io of ‘Proposed Electronic 
Calculator’—is essentially the same as von Neumann’s figure 3. 31 A newspa¬ 
per report of 1946 stated that Turing 'gives credit for the donkey work on the 
A.C.E. to Americans’. 32 ) However, Turing’s logic diagrams set out detailed 
designs for the logical control and the arithmetic part of the calculator 
and go far beyond anything to be found in the ‘First Draft’. The similarities 
between ‘Proposed Electronic Calculator’ and the ‘First Draft' are relatively 
minor in comparison to the striking differences in the designs that they con¬ 
tain (see the Introduction and Chapter 8 ‘Computer Architecture and the 
ACE Computers’). Moreover, von Neumann’s minor influence on ‘Proposed 
Electronic Calculator' should not be allowed to mask the extent to which 
Turing’s universal machine of 1936 was itself a fundamental influence upon 
von Neumann (see below). 

Notoriously, the universal machine of 1936 received no explicit mention 
in ‘Proposed Electronic Calculator’. In his chapter ‘The ACE and the Shaping 
of British Computing' Campbell-Kelly raises the question whether the univer¬ 
sal machine was a ‘direct ancestor’ of the ACE at all, emphasizing that the 
ACE’s ‘addressable memory of fixed-length binary numbers had no equival¬ 
ent in the Turing Machine’. However, Turing's previously unpublished notes 
on memory (in Part V) cast light on this issue. The notes are fragments of 
a draft of ‘Proposed Electronic Calculator': in them Turing related the ACE 
to the universal Turing machine, explaining why the memory arrangement 
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described in ‘On Computable Numbers’ could not ‘be taken over as it stood to 
give a practical form of machine’. 

Turing regarded the ACE as a 'practical version’ of the UTM: 

Some years ago I was researching on what might now be described 
as an investigation of the theoretical possibilities and limitations 
of digital computing machines. I considered a type of machine 
which had a central mechanism, and an infinite memory which was 
contained on an infinite tape ... It can be shown that a single special 
machine of that type can be made to do the work of all. ... The special 
machine may be called the universal machine; it works in the follow¬ 
ing quite simple manner. When we have decided what machine we 
wish to imitate we punch a description of it on the tape of the universal 
machine. ... The universal machine has only to keep looking at this 
description in order to find out what it should do at each stage. Thus 
the complexity of the machine to be imitated is concentrated in the 
tape and does not appear in the universal machine proper in any 
way. ... [Djigital computing machines such as the ACE ... are in fact 
practical versions of the universal machine. There is a certain central 
pool of electronic equipment, and a large memory. When any partic¬ 
ular problem has to be handled the appropriate instructions for the 
computing process involved are stored in the memory of the ACE ... 3 3 

A letter from Turing to the cyberneticist W. Ross Ashby again highlights 
the fundamental point of similarity between the ACE and the UTM: 

The ACE is in fact, analogous to the 'universal machine' described 
in my paper on conputable [sic] numbers ... [W]ithout altering the 
design of the machine itself, it can, in theory at any rate, be used as 
a model of any other machine, by making it remember a suitable set 
of instructions . 34 

Turing’s influence on von Neumann 

In the secondary literature, von Neumann is often said to have invented 
the stored-program computer, but he repeatedly emphasized that the funda¬ 
mental conception was Turing’s. Von Neumann became familiar with ideas 
in ‘On Computable Numbers' during Turing’s time at Princeton (1936-8) 
and was to become intrigued by Turing’s concept of a universal com¬ 
puting machine. 35 It was von Neumann who placed Turing’s concept 
into the hands of American engineers. Stanley Frankel (the Los Alamos 



Turing and the computer 


physicist responsible, with von Neumann and others, for mechanizing the 
large-scale calculations involved in the design of the atomic and hydrogen 
bombs) recorded von Neumann’s view of the importance of ‘On Computable 
Numbers’: 

I know that in or about 1943 or ’44 von Neumann was well aware 
of the fundamental importance of Turing’s paper of 1936 ‘On com¬ 
putable numbers ..which describes in principle the ‘Universal 
Computer' of which every modern computer (perhaps not ENIAC 
as first completed but certainly all later ones) is a realization. 

Von Neumann introduced me to that paper and at his urging I stud¬ 
ied it with care. Many people have acclaimed von Neumann as the 
‘father of the computer’ (in a modern sense of the term) but I am 
sure that he would never have made that mistake himself. He might 
well be called the midwife, perhaps, but he firmly emphasized to me, 
and to others I am sure, that the fundamental conception is owing to 
Turing—insofar as not anticipated by Babbage, Lovelace, and others. 

In my view von Neumann's essential role was in making the world 
aware of these fundamental concepts introduced by Turing and of the 
development work carried out in the Moore school and elsewhere. 36 

In 1944, von Neumann joined the Eckert-Mauchly ENIAC group at the 
Moore School of Electrical Engineering at the University of Pennsylvania. 
(At that time he was involved in the Manhattan Project at Los Alamos, where 
roomfuls of clerks armed with desk calculating machines were struggling to 
carry out the massive calculations required by the physicists.) ENIAC—which 
had been under construction since 1943—was, as mentioned above, not a 
stored-program computer: programming consisted of re-routing cables and 
setting switches. Moreover, the ENIAC was far from universal, having been 
designed with only one very specific task in mind, the calculation of trajector¬ 
ies of artillery shells. Von Neumann brought his knowledge of ‘On Comput¬ 
able Numbers’ to the practical arena of the Moore School. Thanks to Turing’s 
abstract logical work, von Neumann knew that, by making use of coded 
instructions stored in memory, a single machine of fixed structure can in 
principle carry out any task for which a program can be written. When Eckert 
explained his idea of using the mercury delay line as a high-speed recirculat¬ 
ing memory, von Neumann saw that this was the means to make concrete 
the abstract universal computing machine of ‘On Computable Numbers’. 37 

When, in 1946, von Neumann established his own project to build 
a stored-program computer at the Princeton Institute for Advanced Study, 
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he gave his engineers ‘On Computable Numbers’ to read. 38 Bigelow, von 
Neumann’s chief engineer and largely responsible for the engineering design 
of the computer built at the Institute, said: 

The person who really ... pushed the whole field ahead was 
von Neumann, because he understood logically what [the stored- 
program concept] meant in a deeper way than anybody else. ... The 
reason he understood it is because, among other things, he under¬ 
stood a good deal of the mathematical logic which was implied by the 
idea, due to the work of A. M. Turing ... in 1936-1937 .... Turing's 
[universal] machine does not sound much like a modern computer 
today, but nevertheless it was. It was the germinal idea. ... So ... 

[von Neumann] saw ... that [the ENIAC] was just the first step, and 
that great improvement would come. 39 

Von Neumann repeatedly emphasized the fundamental importance of 
‘On Computable Numbers’ in lectures and in correspondence. In 1946 he 
wrote to the mathematician Norbert Wiener of ‘the great positive contri¬ 
bution of Turing’—Turing’s mathematical demonstration that ‘one, definite 
mechanism can be “universal” ’. 40 In 1948, in a lecture entitled ‘The General 
and Logical Theory of Automata’, von Neumann said: 

The English logician, Turing, about twelve years ago attacked the 
following problem. He wanted to give a general definition of what is 
meant by a computing automaton. ... Turing carried out a careful 
analysis of what mathematical processes can be effected by automata 
of this type. ... He ... also introducefd] and analysefd] the concept 
of a ‘universal automaton’ ... An automaton is ‘universal’ if any 
sequence that can be produced by any automaton at all can also be 
solved by this particular automaton. It will, of course, require in 
general a different instruction for this purpose. The Main Result of 
the Turing Theory. We might expect a priori that this is impossible. 

How can there be an automaton which is at least as effective as any 
conceivable automaton, including, for example, one of twice its size 
and complexity? Turing, nevertheless, proved that this is possible. 41 

The following year, in a lecture entitled ‘Rigorous Theories of Control and 
Information’, von Neumann said: 

The importance of Turing’s research is just this: that if you con¬ 
struct an automaton right, then any additional requirements about 
the automaton can be handled by sufficiently elaborate instructions. 
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This is only true if [the automaton] is sufficiently complicated, if it has 
reached a certain minimal level of complexity. In other words... there 
is a very definite finite point where an automaton of this complexity 
can, when given suitable instructions, do anything that can be done 
by automata at all. 4 ^ 

Many books on the history of computing in the United States make no 
mention of Turing. No doubt this is in part explained by the absence of 
any explicit reference to Turing’s work in the series of technical reports in 
which von Neumann, with various co-authors, set out a logical design for 
an electronic stored-program digital computer. 43 Nevertheless there is evid¬ 
ence in these documents of von Neumann’s knowledge of ‘On Computable 
Numbers’. For example, in the report entitled ‘Preliminary Discussion 
of the Logical Design of an Electronic Computing Instrument’ (1946), 
von Neumann and his co-authors, Burks and Goldstine—both former 
members of the ENIAC group, who had joined von Neumann at the Institute 
for Advanced Study—wrote the following: 

First Remarks on the Control and Code : It is easy to see by formal- 
logical methods, that there exist codes that are in abstracto adequate 
to control and cause the execution of any sequence of operations 
which are individually available in the machine and which are, in 
their entirety, conceivable by the problem planner. The really decisive 
considerations from the present point of view, in selecting a code, are 
more of a practical nature: Simplicity of the equipment demanded by 
the code, and the clarity of its application to the actually important 
problems together with the speed of its handling of those problems. 44 

Burks has confirmed that the first sentence of this passage is a reference to the 
UTM. 45 (The report was not intended for formal publication and no attempt 
was made to indicate those places where reference was being made to the 
work of others.) 

The passage just quoted is an excellent summary of the situation at that 
time. In ‘On Computable Numbers' Turing had shown in abstracto that, by 
means of instructions expressed in the programming code of his ‘standard 
descriptions’, a single machine of fixed structure is able to carry out any 
task that a ‘problem planner’ is able to analyse into effective steps. By 1945, 
considerations in abstracto had given way to the practical problem of devising 
an equivalent programming code that could be implemented efficiently by 
means of electronic circuits. Von Neumann’s embryonic code appeared in 
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the ‘First Draft’. ‘Proposed Electronic Calculator' set out Turing’s own very 
different and much more fully developed code. 

The Manchester computer 

The first stored-program electronic computer, the Manchester ‘Baby’, came 
to life in June 1948 in Newman’s Computing Machine Laboratory at the 
University of Manchester. 46 

At the time of the Baby and its successor, the Manchester Mark I, the 
electronic engineers Williams and Kilburn, who had translated the logico- 
mathematical idea of the stored-program computer into hardware, were 
given too little credit by the mathematicians at Manchester—Williams and 
Kilburn were regarded as excellent engineers but not as ‘ideas men’. 4 ' 
Nowadays the tables have turned too far and the triumph at Manchester 
is usually credited to Williams and Kilburn alone. Fortunately the words of 
the late Freddie Williams survive to set the record straight: 

Now let’s be clear before we go any further that neither Tom Kilburn 
nor I knew the first thing about computers when we arrived in 
Manchester University ... Newman explained the whole business of 
how a computer works to us. 48 

Tom Kilburn and I knew nothing about computers ... 
Professor Newman and Mr A. M. Turing ... knew a lot about com¬ 
puters ... They took us by the hand and explained how numbers could 
live in houses with addresses .. . 49 

In an address to the Royal Society on 4 March 1948, Newman presented 
this very explanation: 

In modern times the idea of a universal calculating machine 
was independently [of Babbage] introduced by Turing ... There is 
provision for storing numbers, say in the scale of 2, so that each 
number appears as a row of, say, forty o’s and i’s in certain places or 
‘houses’ in the machine. ... Certain of these numbers, or 'words’ are 
read, one after another, as orders. In one possible type of machine an 
order consists of four numbers, for example 11, 13, 27, 4. The num¬ 
ber 4 signifies ‘add’, and when control shifts to this word the ‘houses’ 

Hu and H13 will be connected to the adder as inputs, and H27 as 
output. The numbers stored in Hu and Hi3 pass through the adder, 
are added, and the sum is passed on to H27. The control then shifts to 
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the next order. In most real machines the process just described would 
be done by three separate orders, the first bringing (Hll) (^content 
of Hii) to a central accumulator, the second adding (H13) into the 
accumulator, and the third sending the result to H27; thus only one 
address would be required in each order. ... A machine with stor¬ 
age, with this automatic-telephone-exchange arrangement and with 
the necessary adders, subtractors and so on, is, in a sense, already 
a universal machine. 0 

Following this explanation of Turing’s three-address concept (source 1, 
source 2, destination, function) Newman went on to describe program 
storage (‘the orders shall be in a series of houses Xi, X2, ...’) and 
conditional branching. He then summed up: 

From this highly simplified account it emerges that the essential 
internal parts of the machine are, first, a storage for numbers (which 
may also be orders). ... Secondly, adders, multipliers, etc. Thirdly, 
an 'automatic telephone exchange' for selecting 'houses’, connect¬ 
ing them to the arithmetic organ, and writing the answers in other 
prescribed houses. Finally, means of moving control at any stage to 
any chosen order, if a certain condition is satisfied, otherwise passing 
to the next order in the normal sequence. Besides these there must be 
ways of setting up the machine at the outset, and extracting the final 
answer in useable form. 51 

In a letter written in 1972 Williams described in some detail what he and 
Kilburn were told by Newman: 

About the middle of the year [1946] the possibility of an appoint¬ 
ment at Manchester University arose and I had a talk with Professor 
Newman who was already interested in the possibility of develop¬ 
ing computers and had acquired a grant from the Royal Society 
of £30,000 for this purpose. Since he understood computers and 
I understood electronics the possibilities of fruitful collaboration were 
obvious. I remember Newman giving us a few lectures in which he 
outlined the organisation of a computer in terms of numbers being 
identified by the address of the house in which they were placed and 
in terms of numbers being transferred from this address, one at a 
time, to an accumulator where each entering number was added to 
what was already there. At any time the number in the accumu¬ 
lator could be transferred back to an assigned address in the store 
and the accumulator cleared for further use. The transfers were to 
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be effected by a stored program in which a list of instructions was 
obeyed sequentially. Ordered progress through the list could be inter¬ 
rupted by a test instruction which examined the sign of the number 
in the accumulator. Thereafter operation started from a new point in 
the list of instructions. This was the first information I received about 
the organisation of computers.... Our first computer was the simplest 
embodiment of these principles, with the sole difference that it used 
a subtracting rather than an adding accumulator. 5 - 

Turing’s early input to the developments at Manchester, hinted at by 
Williams in his above-quoted reference to Turing, may have been via the 
lectures on computer design that Turing and Wilkinson gave in London 
during the period December 1946 to February 1947 (see Chapter 22, ‘The 
Turing-Wilkinson Lecture Series’). The lectures were attended by repres¬ 
entatives of various organizations planning to use or build an electronic 
computer. Kilburn was in the audience. 53 (Kilburn usually said, when asked 
from where he obtained his basic knowledge of the computer, that he could 
not remember; 54 e.g., in a 1992 interview he said: ‘Between early 1945 and 
early 1947. in that period, somehow or other f knew what a digital computer 
was ... Where 1 got this knowledge from I’ve no idea'.’ 5 ) 

Whatever role Turing’s lectures may have played in informing Kilburn, 
there is little doubt that credit for the Manchester computer—called the 
‘Newman-Williams machine’ by Huskey in a report written shortly after his 
visit in 1947 to the Manchester project (see Chapter 23, ‘The State of the Art 
in Electronic Digital Computing in Britain and the United States’)—belongs 
not only to Williams and Kilburn but also to Newman, and that the influ¬ 
ence on Newman of Turing’s 1936 paper was crucial (as was the influence of 
Flowers’ Colossus). 

The Manchester computer and the EDVAC 

The Baby and the Manchester Mark I are sometimes said to have descended 
from the EDVAC (see, e.g., the American Family Tree of Computer Design , fig. 1 
in Chapter 6). Newman was well aware of von Neumann’s ‘First Draft of 
a Report on the EDVAC’. In the summer of 1946 he sent David Rees, a lec¬ 
turer in his department at Manchester and an ex-member of the Newmanry 
(Newman’s section at Bletchley Park), to a series of lectures at the Moore 
School, where Eckert, Mauchly, and other members of the ENIAC-EDVAC 
group publicized their ideas on computer design. 56 In the autumn of 1946 
Newman himself went to Princeton for three months. 57 
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Newman’s advocacy of ‘a central accumulator’—a characteristic feature 
of the EDVAC but not of the ACE—was probably influenced by his knowledge 
of the American proposals. However, von Neumann’s ideas seem to have had 
little influence on other members of the Manchester project. Kilburn spoke 
scathingly of the von Neumann ‘dictat’. 58 Tootill said: 

Williams, Kilburn and I (the three designers of the first Manchester 
machine) had all spent the 1939-1945 war at the Telecommu¬ 
nications Research Establishment doing R & D on radiolocation 
equipments. The main U.S. ideas that we accepted in return for our 
initiatives on these and later on computers were the terms 'radar’ and 
'memory'... We disliked the latter term, incidentally, as encouraging 
the anthropomorphic concept of 'machines that think ’. 59 

To the best of my recollection PC [Williams], Tom [Kilburn] and I 
never discussed ... von Neumann’s ... ideas during the development 
of the Small-Scale Experimental Machine [the Baby], nor did I have 
any knowledge of them when 1 designed the Ferranti Mk I. I don't 
think FC was influenced at all by von Neumann, because I think 
he was in general quite punctilious in acknowledging other people’s 
ideas . 60 

Tootill added: 

As well as our own ideas, we incorporated functions suggested by 
Turing and Newman in the improvement and extension of the first 
machine. When I did the logic design of the Ferranti Mark I, I got 
them to approve the list of functions . 61 


Turing joins the Manchester project 

In May 1948 Turing resigned from the NPL. Work on the ACE had drawn 
almost to a standstill (see Chapter 3, ‘The Origins and Development of the 
ACE Project’). Newman lured a ‘very fed up’ 62 Turing to Manchester, where 
in May 1948 he was appointed Deputy Director of the Computing Machine 
Laboratory (there being no Director). Turing designed the input mechanism 
and programming system 63 of, and wrote a programming manual 64 for, the 
full-scale Manchester computer. (The first of the production models, marketed 
by Ferranti, was completed in February 1951 and was the first commercially 
available electronic digital computer. 65 The first US commercial machine, the 
Eckert-Mauchly UNIVAC, appeared a few months later.) At last Turing had 
his hands on a stored-program computer. 
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Artificial Intelligence 

The myth 

Artificial Intelligence (AI) is often said to have been born in the mid-1950s 
in the United States. For example: 

Artificial Intelligence, conceived at Carnegie Tech in the autumn 
of 1955. quickened by Christmas, and delivered on Johnniac in the 
spring, made a stunning debut at the conference from which it later 
took its name. 66 

The AI program ‘delivered on Johnniac’ (a Californian copy of the IAS 
computer) was the Logic Theorist, written by Newell, Simon, and Shaw 
and demonstrated at a conference, the Dartmouth Summer Research Project 
on Artificial Intelligence, held at Dartmouth College, New Hampshire. 6 ' 
The Logic Theorist was designed to prove theorems from Whitehead and 
Russell’s Principia Mathematical (In one case the proof devised by the Logic 
Theorist was several lines shorter than the one given by Whitehead and 
Russell: Newell, Simon, and Shaw wrote up the proof and sent it to the 
Journal of Symbolic Logic. This was almost certainly the first paper to have 
a computer listed as a co-author, but unfortunately it was rejected. 69 ) 

The reality 

In Britain the term 'machine intelligence' pre-dated ‘artificial intelligence’, 
and the field of enquiry itself can be traced much further back than 1955. 
If anywhere has a claim to be the birthplace of AI, it is Bletchley Park. 
Turing was the first to carry out substantial research in the area. At least 
as early as 1941 he was thinking about machine intelligence—in particu¬ 
lar the possibility of computing machines that solved problems by means 
of searching through the space of possible solutions, guided by what would 
now be called ‘heuristic’ principles—and about the mechanization of chess. ‘ 0 
At Bletchley Park, in his spare time, Turing discussed these topics and also 
machine learning. He circulated a typescript concerning machine intelli¬ 
gence among some of his colleagues. 71 Now lost, this was undoubtedly the 
earliest paper in the field of AI. 

The first AI programs ran in Britain in 1951-2, at Manchester and 
Cambridge. This was due in part to the fact that the first stored-program 
electronic computers ran in Britain and in part to Turing’s influence on the 
first generation of computer programmers. (Even in the United States, the 
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Logic Theorist was not the first AI program to run. Arthur Samuel’s Checkers 
(or Draughts) Player first ran at the end of 1952 on the IBM 701. IBM’s first 
stored-program electronic digital computer . 72 In 1955 Samuel added learning 
to the program.) 


The Bombe 

The Bombe is the first milestone in the history of machine intelligence. / 3 
Central to the Bombe was the idea of solving a problem by means of a guided 
mechanical search through the space of possible solutions, fn this instance, 
the space of possible solutions consisted of configurations of the Enigma 
machine (in another case it might consist of configurations of a chess board). 
The Bombe's search could be guided in various ways; one involved what 
Turing called the ‘multiple encipherment condition’ associated with a crib 
(described in Chapter 6 of Turing’s recently declassified Treatise on the Enigma, 
written in the second half of 1940). /4 A search guided in this fashion, Turing 
said, would ‘reduce the possible positions to a number which can be tested by 
hand methods’. 75 (A crib is a word or phrase that the cryptanalyst believes 
might be part of the German message. For example, it might be conjectured 
that a certain message contains ‘WETTER FUR DIE NACHT’ (weather for the 
night). Many Enigma networks were good sources of cribs, thanks both to 
the stereotyped nature of German military messages and to lapses of cipher 
security. One station sent exactly the same message (‘beacons lit as ordered’) 
each evening for a period of several months. 76 ) 

Modern AI researchers speak of the method of generate-and-test. Potential 
solutions to a given problem are generated by means of a guided search. These 
potential solutions are then tested by an auxiliary method to find out if any 
is actually a solution. Nowadays in AI both processes, generate and test, are 
typically carried out by the same program. The Bombe mechanized the first 
process. The testing of the potential solutions (the ‘stops') was then carried 
out manually (by setting up a replica Enigma accordingly, typing in the cipher 
text, and seeing whether or not German words emerged). 


Machine intelligence, 1945-8 

In designing the ACE, machine intelligence was not far from Turing’s 
thoughts—he described himself as building ‘a brain’ 77 and declared 
‘In working on the ACE I am more interested in the possibility of producing 
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models of the action of the brain than in the practical applications to 
computing’/ 8 In ‘ProposedElectronic Calculator’ he said: 

‘Can the machine play chess?’ It could fairly easily be made to play a 
rather bad game. It would be bad because chess requires intelligence. 

We stated at the beginning of this section that the machine should be 
treated as entirely without intelligence. There are indications however 
that it is possible to make the machine display intelligence at the risk of 
its making occasional serious mistakes. By following up this aspect the 
machine could probably be made to play very good chess. 

Turing’s point was probably that the use of heuristic search brings with it the 
risk of the machine’s sometimes making mistakes. 

In February 1947 (in the rooms of the Royal Astronomical Society in 
Burlington House, London' 9 ) Turing gave what is, so far as is known, the 
earliest public lecture to mention computer intelligence, providing a breath¬ 
taking glimpse of a new field. 80 He described the human brain as a ‘digital 
computing machine’ 81 and discussed the prospect of machines that act intel¬ 
ligently, learn, and beat human opponents at chess. He stated that '[w]hat we 
want is a machine that can learn from experience’ and that ‘[t]he possibility 
of letting the machine alter its own instructions provides the mechanism for 
this’. 82 (The possibility of a computer’s operating on and modifying its own 
program as it runs, just as it operates on the data in its memory, is impli¬ 
cit in the stored-program concept.) At the end of the 1947 lecture Turing 
set out what he later called the ‘Mathematical Objection’ to the hypothesis 
of machine intelligence. This is now widely known as the Godel argument, 
and has been made famous by John Lucas and Roger Penrose. (In fact the 
objection originated with the mathematical logician Emil Post, as early as 
1921. 83 ) Turing proposed an interesting and arguably correct solution to the 
objection. 84 

In mid-1947, with little progress on the physical construction of the ACE, 
a thoroughly disheartened Turing applied for a twelve-month period of sab¬ 
batical leave to be spent in Cambridge. The purpose of the leave, as described 
by Darwin in July 1947, was to enable Turing 

to extend his work on the [ACE] still further towards the biological 
side. I can best describe it by saying that hitherto the machine has 
been planned for work equivalent to that of the lower parts of the 
brain, and [Turing] wants to see how much a machine can do for the 
higher ones; for example, could a machine be made that could learn 
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by experience? This will be theoretical work, and better done away 
from here. 85 

Turing left the NPL for Cambridge in the autumn of 194 7. 86 

In the summer of 1948 Turing completed a report describing the outcomes 
of this research. It was entitled ‘Intelligent Machinery’. 8/ Donald Michie 
recalls that Turing 

was in a state of some agitation about its reception by his superiors 
at N.P.L.: A bit thin for a year’s time off!’. 88 

The headmasterly Darwin—who once complained about the ‘smudgy’ 
appearance of Turing’s work 89 —was, as Turing predicted, displeased with 
‘Intelligent Machinery’, describing it as a ‘schoolboy’s essay’ 90 and ‘not 
suitable for publication’. 91 In reality this far-sighted paper was the first 
manifesto of Artificial Intelligence; sadly Turing never published it. 

‘Intelligent Machinery’ is a wide-ranging and strikingly original survey 
of the prospects of AI. In it Turing brilliantly introduced a number of the 
concepts that were later to become central in AI, in some cases after reinven¬ 
tion by others. These included the logic-based approach to problem-solving, 
now widely used in expert systems, and, in a brief passage concerning 
what he called ‘genetical or evolutionary search’ 92 , the concept of a genetic 
algorithm—important in both AI and Artificial Life. (The term 'genetic 
algorithm' was introduced in c.1975. 93 ) In the light of his work with 
the Bombe, it is not surprising to find Turing hypothesizing in ‘Intelligent 
Machinery’ that ‘intellectual activity consists mainly of various kinds of 
search’. 94 Eight years later the same hypothesis was put forward independ¬ 
ently by Newell and Simon and through their influential work 93 became one 
of the principal tenets of AI. ‘Intelligent Machinery’ also contains the earliest 
description of (a restricted form of) what Turing was later to call the ‘imitation 
game’ and is now known simply as the Turing test. 96 

The first AI programs 

Both during and after the war Turing experimented with machine routines 
for playing chess: in the absence of a computer, the machine’s behaviour 
was simulated by hand, using paper and pencil. In 1948 Turing and David 
Champernowne, the mathematical economist, constructed the loose system 
of rules dubbed the ‘Turochamp’. 97 (Champernowne reported that his wife, 
a beginner at chess, took on the Turochamp and lost.) Turing began to 
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program the Turochamp for the Manchester Ferranti Mark I but unfortu¬ 
nately never completed the task." He later published a classic early article 
on chess programming." Dietrich Prinz, who worked for Ferranti, wrote 
the first chess program to be implemented. 100 It ran in November 1951 
on the Ferranti Mark I. 101 Unlike the Turochamp, Prinz’s program could 
not play a complete game and operated by exhaustive search rather than 
under the guidance of heuristics. (Prinz 'learned all about programming the 
Mark I computer at seminars given by Alan Turing and Cecily Popplewell’. 102 
Like Turing, he wrote a programming manual for the Mark I. 103 Prinz also 
used the Mark I to solve logical problems, and in 1949 and 1951 Ferranti 
built two small experimental special-purpose computers for theorem-proving 
and other logical work. 104 ) 

Christopher Strachey’s Draughts Player was—apart from Turing's ‘paper’ 
chess-players—the first AI program to use heuristic search. He coded it for the 
Pilot Model ACE in May 1951. 105 Strachey’s first attempt to get his program 
running on the Pilot ACE was defeated by coding errors. When he returned to 
the NPL with a debugged version of the program, he found that a major hard¬ 
ware change had been made, with the result that the program would not run 
without substantial revision. 106 He finally got his program working on the 
Ferranti Mark I in mid-1952 (with Turing’s encouragement and utilizing the 
latter’s recently completed Programmer’s Handbook 107 ). 108 By the summer of 
1952 the program could play a complete game of draughts at a reasonable 
speed. 109 The essentials of Strachey’s program were taken over by Samuel 
in the United States. 110 

The first AI programs to incorporate learning, written by Anthony 
Oettinger at the University of Cambridge, ran in 1951. 111 Oettinger wrote his 
‘response learning programme’ and ‘shopping programme’ for the Cambridge 
EDSAC computer. Oettinger was considerably influenced by Turing’s views on 
machine learning, 112 and suggested that the shopping program—which sim¬ 
ulated the behaviour of ‘a small child sent on a shopping tour' 113 —could pass 
a version of the Turing test in which ‘the questions are restricted to ... the 
form “In what shop may article; be found?”’ 114 . 

Turing’s unorganized computing machines 

Turing did not only invent the concept of the stored-program digital 
computer; he also pioneered the idea of computing by neural networks. The 
major part of ‘Intelligent Machinery’ is a discussion of (what Turing called) 
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‘unorganised machines’. 115,116 His unorganized computing machines have 
been ignored by historians of the computer and merit a detailed introduction. 

Turing described three types of unorganized machine. A-type and B-type 
unorganized machines consist of randomly connected two-state ‘neurons’ 
whose operation is synchronized by means of a central digital clock. We call 
these networks ‘Turing Nets'. Turing’s P-type unorganized machines are not 
neuron-like but are modified Turing machines: they have ‘only two interfer¬ 
ing inputs, one for “pleasure” or "reward” ... and the other for “pain” or 
“punishment" '. 11/ Turing studied P-types in the hope of discovering pro¬ 
cedures for 'training' a machine to carry out a task. (It is a P-type machine 
that Turing was speaking of when, in the course of his famous discussion of 
strategies for building machines to pass the Turing test, he said ‘I have done 
some experiments with one such child-machine, and succeeded in teaching 
it a few things'. 118 ) 

Turing had no doubts concerning the significance of his unorganized 
machines. Of Turing Nets, he said 

[M] achines of this character can behave in a very complicated manner 
when the number of units is large ... A-type unorganised machines 
are of interest as being about the simplest model of a nervous system 
with a random arrangement of neurons. It would therefore be of very 
great interest to find out something about their behaviour. 116 

He theorized that ‘the cortex of the infant is an unorganised machine, which 
can be organised by suitable interfering training’. 120 Turing found ‘this 
picture of the cortex as an unorganised machine ... very satisfactory from 
the point of view of evolution and genetics’. 121 

A-type unorganized machines 

Turing introduced the idea of an unorganized machine by means of an 
example: 

A typical example of an unorganised machine would be as follows. 

The machine is made up from a rather large number N of similar units. 

Each unit has two input terminals, and has an output terminal which 
can be connected to the input terminals of (o or more) other units. 

We may imagine that for each integer r, I < r <N, two numbers z(r) 
and j(r) are chosen at random from I ... N and that we connect the 
inputs of unit r to the outputs of units i(r) and j(r). All of the units are 
connected to a central synchronising unit from which synchronising 
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pulses are emitted at more or less equal intervals of time. The times 
when these pulses arrive will be called ‘moments’. Each unit is capable 
of having two states at each moment. These states may be called 
o and i. 122 

Turing then gave (what would now be called) a propagation rule and an 
activation rule for the network. A propagation rule calculates the net input 
into a unit, and an activation rule calculates the new state of a unit, given its 
net input. The propagation rule is: 

The net input into unit r at moment m, net(r, in), is the product 
of the state of i(r) at m -1 and the state of j(r) at m- 1. 

The activation rule is: 

The state of r at m is i-net(r, m). 

A network of the sort that Turing described in the above quotation and whose 
behaviour is determined by these two rules is an A-type unorganized machine. 

In modern terminology an A-type machine is a collection of NAND units. 
The propagation rule in effect takes the conjunction of the values on the 
unit's two input lines, and the activation rule forms the negation of this 
value. Alternative choices of propagation rule and/or activation rule will 
cause the units to perform other Boolean operations. As is well known, NAND 
is a fundamental operation in the sense that any Boolean operation can be 
performed by a circuit consisting entirely of NAND units. Thus any such 
operation can be performed by an A-type machine. 123 

B-type unorganized machines 

The most significant aspect of Turing’s discussion of unorganized machines 
is undoubtedly his idea that an initially random network can be organized 
to perform a specified task by means of what he described as 'interfering 
training’. 124 

Many unorganised machines have configurations such that if once 
that configuration is reached, and if the interference thereafter is 
appropriately restricted, the machine behaves as one organised for 
some definite purpose. 125 

Turing illustrated this idea by means of the circuit shown in fig. I . 126 
(He stressed that this particular circuit is employed ‘for illustrative purposes’ 
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and not because it is ‘of any great intrinsic importance’. 127 ) We call a pair 
of units (A and B) connected in the way shown an 'introverted pair’. By 
means of external interference the state of unit A may be set to either o or i; 
this state will be referred to as the ‘determining condition’ of the pair. The 
signal produced in unit B’s free output connection is constant from moment 
to moment and the polarity of the signal depends only upon the determining 
condition of the pair. Thus an introverted pair functions as an elementary 
memory. 128 

Turing defined B-type machines in terms of a certain process of substitution 
applied to A-type machines: a B-type results if every unit-to-unit connection 
within an A-type machine is replaced by the device shown in fig. 2. 129 That 
is to say, what is in the A-type a simple connection between points D and E 
now passes via the depicted device. 110 

Depending on the polarity of the constant signal at C, the signal at E is 
either 1 if the signal at D is o and o if the signal at D is 1, or always 1 no 
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matter what the signal at D. In the first of these cases the device functions 
as a negation module. In the second case the device in effect disables the 
connection to which it is attached. That is to say, a unit with the device 
attached to one of its input connections delivers an output that is a function 
only of the signal arriving along its other input connection. (If the devices 
on both the unit’s input connections are placed in disable mode then the 
unit's output is always O.) Using these devices an external agent can organ¬ 
ize an initially random B-type machine, selectively disabling and enabling 
connections within it. 

Turing claimed that it is a ‘general property of B-type machines ... that 
with suitable initial [i.e. determining] conditions they will do any required 
job, given sufficient time and provided the number of units is sufficient’. 131 
This follows from the more specific claim that given ‘a B-type unorganised 
machine with sufficient units one can find initial conditions which will make 
it into a universal [Turing] machine with a given storage capacity’. 132 This 
claim first opened up the possibility, noted by Turing, 133 that the human 
brain is (in part) a UTM implemented in a neural network. 

B-types redefined 

Concerning his claim that one can configure a B-type network (with sufficient 
units) such that it is a UTM with a finite tape, Turing remarked: A formal 
proof to this effect might be of some interest, or even a demonstration of it 
starting with a particular unorganised B-type machine, but I am not giving 
it as it lies rather too far outside the main argument’. 134 It is unfortunate 
that Turing did not give any details of the proof, for this might have cast 
some light on what appears to be an inconsistency in ‘Intelligent Machinery’. 
It is reasonably obvious that not all Boolean functions can be computed 
by B-type machines as defined. (A good way to get a feel for the difficulty 
is to attempt to design a B-type circuit for computing XOR—exclusive 
disjunction.) 

‘Intelligent Machinery’ contains no clues as to Turing's own procedure 
for dealing with this problem. The simplest remedy seems to be to modify the 
substitution in terms of which B-type machines are defined: a B-type results if 
every unit-to-unit connection within an A-type machine is replaced by two of 
the devices shown in fig. 2, linked in series. That is to say, what is in the A-type 
a simple connection between two units now passes through two additional 
units each with its own introverted pair attached. It is trivially the case that 
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if a function can be computed by some A-type machine then it can also be 
computed by some machine satisfying the modified definition of a B-type. 

Turing’s anticipation of connectionism 

So far as we have been able to discover, Turing was the first person to consider 
building computing machines out of simple, neuron-like elements connected 
together into networks in a largely random manner. His account of B-types 
anticipated the modern approach to Af known as connectionism (i.e. com¬ 
putation by neural networks). 135 Rosenblatt—the inventor of the type of 
neural net called the ‘perceptron’—introduced the term ‘connectionist' in 
the following way: 

[According to] theorists in the empiricist tradition ... the stored 
information takes the form of new connections, or transmission 
channels in the nervous system (or the creation of conditions which 
are functionally equivalent to new connections) ... The theory to be 
presented here takes the empiricist, or ‘connectionist’ position. 1 J 

Turing's arrangement of selectively disabling and enabling connections 
within a B-type machine is functionally equivalent to one in which the stored 
information takes the form of new connections within the network. 

Turing also envisaged the procedure—nowadays used extensively by 
connectionists—of programming training algorithms into a computer 
simulation of the unorganized machine. In modern architectures repeated 
applications of a training algorithm (e.g. the ‘back propagation’ algorithm) 
cause the encoding of the problem solution to develop gradually within 
the network during the training phase. Turing had no algorithm for train¬ 
ing his B-types. 137 He regarded the development of training algorithms for 
unorganized machines as a central problem. With characteristic farsighted¬ 
ness Turing ended his discussion of unorganized machines by sketching the 
research programme that connectionists are now pursuing: 

I feel that more should be done on these lines. I would like to invest¬ 
igate other types of unorganised machines ... When some electronic 
machines are in actual operation I hope that they will make this more 
feasible. It should be easy to make a model of any particular machine 
that one wishes to work on within such a UPCM [universal practical 
computing machine] instead of having to work with a paper machine 
as at present. If also one decided on quite definite ‘teaching policies’ 
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these could also be programmed into the machine. One would then 
allow the whole system to run for an appreciable period, and then 
break in as a kind of ‘inspector of schools' and see what progress had 
been made . 138 

As a result of his lukewarm interest in publication Turing’s work on 
neuron-like computation remained unknown to others working in the area. 
Modern connectionists regard the work of Donald Hebb 1 59 and Frank 
Rosenblatt 140 as the foundation of their approach. Turing’s unorganized 
machines were not mentioned by the other pioneers of neuron-like compu¬ 
tation in Britain—Ross Ashby, 141 Beurle, 142 Taylor, 143 and Uttley. 144 The 
situation was identical on the other side of the Atlantic. Rosenblatt seemed 
not to have heard of Turing’s unorganized machines. 145 Nor was Turing’s 
work mentioned in Hebb’s influential book The Organization of Behavior — 
the source of the so-called Hebbian approach to neural learning studied in 
connectionism today. 146 Modern discussions of the history of connection- 
ism by Rumelhart, McClelland et al. 147 show no awareness of Turing’s early 
contribution to the field. 148 

Turing himself was unable to pursue his research into unorganized 
machines very far. At the time, the only electronic stored-program com¬ 
puter in existence was the Manchester Baby. By the time Turing had access 
to the Ferranti Mark I, in 1951, his interests had shifted and he devoted 
his time to modelling biological growth. (It was not until 1954, the year 
of Turing’s death, that Farley and Clark, working independently of Turing 
at MIT, succeeded in running the first computer simulation of a small neural 
network. 149 ) In Mathematics Division Davies and Woodger pursued Turing’s 
ideas on learning (see Chapter 15, ‘The ACE Simulator and the Cybernetic 
Model’). Their Cybernetic Model, constructed in 1949, was a hardware 
simulation of six Boolean neurons. In a demonstration on BBC TV in 1950, 
the Cybernetic Model mimicked simple learning in an octopus. 

McCulloch and Pitts 

It is interesting that Turing made no reference in the 1948 report to the work 
of McCulloch and Pitts, itself influenced by his ‘On Computable Numbers’. 
Their 1943 article represents the first attempt to apply what they refer to as 
‘the Turing definition of computability’ to the study of neuronal function. 150 
McCulloch stressed the extent to which his and Pitts’ work was indebted 
to Turing in the course of some autobiographical remarks (made during 
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the public discussion of a lecture by von Neumann in 1948): 

I started at entirely the wrong angle ... and it was not until I saw 
Turing's paper [‘On Computable Numbers’] that I began to get going 
the right way around, and with Pitts’ help formulated the required 
logical calculus. What we thought we were doing (and I think we 
succeeded fairly well) was treating the brain as a Turing machine . 151 

Like Turing, McCulloch and Pitts considered Boolean nets of simple two- 
state ‘neurons'. In their 1943 article they showed that such a net augmented 
by an external tape can compute all (and only) numbers that can be computed 
by Turing machines; and that, without the external tape, some but not all 
of these numbers can be computed by nets. Unlike modern connectionists, 
but like Turing, McCulloch and Pitts made no use of weighted connections 
or variable thresholds. (Part of the burden of their argument is to show that 
the behaviour of a net of binary units with variable thresholds can be exactly 
mimicked by a simple Boolean net without thresholds ‘provided the exact time 
for impulses to pass through the whole net is not crucial’. 152 ) McCulloch and 
Pitts did not discuss universal machines. 

Turing had unquestionably heard something of the work of McCulloch 
and Pitts. Von Neumann mentioned the McCulloch-Pitts article—albeit very 
briefly—in the ‘First Draft of a Report on the EDVAC’ and (as noted above) 
employed a modified version of their diagrammatic notation for neural nets. 
Wiener would almost certainly have mentioned McCulloch in the course of 
his ‘talk over the fundamental ideas of cybernetics with Mr Turing' at the 
NPL in the spring of 1947. 153 (Wiener and McCulloch were founding mem¬ 
bers of the cybernetics movement.) Turing and McCulloch seem not to have 
met until 1949. After their meeting Turing spoke dismissively of McCulloch, 
referring to him as ‘a charlatan'. 151 It is an open question whether the work 
of McCulloch and Pitts had any influence whatsoever on the development of 
the ideas presented in 'Intelligent Machinery’. (Max Newman remarked of 
Turing ‘It was, perhaps, a defect of his qualities that he found it hard to use 
the work of others, preferring to work things out for himself'. 1 ’ 5 ) 

Whatever the influences were on Turing at that time, there is no doubt 
that his work on neural nets goes importantly beyond the earlier work 
of McCulloch and Pitts. The latter gave only a perfunctory discussion of 
learning, saying no more than that the mechanisms supposedly underlying 
learning in the brain—they specifically mentioned threshold change and the 
formation of new synapses—can be mimicked by means of nets whose 
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connections and thresholds remain unaltered. 156 Turing’s idea of using 
supervised interference to train an initially random arrangement of units 
to compute a specified function was nowhere prefigured. 

P-type unorganized machines 

Turing's main purpose in studying P-type machines seems to have been to 
search for general training procedures. A P-type machine is a modified Turing 
machine. Chief among the modifications is the addition of two input lines, 
one for reward ('pleasure') and the other for punishment (‘pain’). 15/ Unlike 
standard Turing machines a P-type has no tape. Initially a P-type machine is 
unorganized in the sense that its instruction table is ‘largely incomplete’. 158 
Application of either pleasure or pain by the trainer serves to alter an incom¬ 
plete table to some successor table. After sufficient training a complete table 
may emerge. 

The P-types that Turing explicitly considered have instruction tables 
consisting of three columns (unlike the four-column tables of ‘On Computable 
Numbers’ described above). An example (a simplified version of Turing’s 
own 139 ) is: 


State 

Control 

symbol 

External 

action 

1 

U 

A 

2 

Do 

B 

3 

Ti 

B 

4 

U 

A 

5 

Di 

B 


‘U’ means ‘uncertain’, ‘T’ means ‘tentative’, and ‘D’ means ‘definite’. (The 
nature of the external actions A and B is not specified.) This table is incom¬ 
plete in that no control symbol at all is specified for states i and 4 and the 
control symbol 1 has been entered only tentatively in the line for state 3. Only 
in the case of states 2 and 5 are definite control symbols listed. The table 
is complete only when a definite control symbol has been specified for 
each state. 

The control symbol determines the state the machine is to go into once 
it has performed the specified external action. The rules that Turing gave 
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governing the state transitions are: 

1. If the control symbol is I, either definitely or tentatively, then next state is 
the remainder of ((2 x present state ) + 1) on division by the total number 
of states (in this case 5). 

For example, if the machine is in state 3 then next state is 2. 

2. If the control symbol is o, either definitely or tentatively, then next state 
is the remainder of (2 x present state ) on division by the total number of 
states. 

For example, if the machine is in state 2 then next state is 4. 

Let us suppose that the machine is set in motion in state 2. It performs 
the external action B, shifts to state 4, and performs the action A. No control 
symbol is specified in state 4. In this case the machine selects a binary digit at 
random, say o, and replaces U by To. The choice of control symbol determines 
the next state, in this case 3. 

The trainer may apply a pleasure or pain stimulus at any time, with the 
effect that ‘[w]hen a pain stimulus occurs all tentative entries are cancelled, 
and when a pleasure stimulus occurs they are all made permanent’. 160 
In other words, pleasure replaces every T in the table by D and pain replaces 
all occurrences of To and Ti by U. 

Turing suggested that 'it is probably possible to organise these P-type 
machines into universal machines’ but warned that this ‘is not easy’. 161 
He continued: 

If, however, we supply the P-type machine with a systematic external 
memory this organising becomes quite feasible. Such a memory could 
be provided in the form of a tape, and the [external actions] could 
include movement to right and left along the tape, and altering the 
symbol on the tape to o or 1 ... I have succeeded in organising such 
a (paper) machine into a universal machine ... This P-type machine 
with external memory has, it must be admitted, considerably more 
‘organisation’ than say the A-type unorganised machine. Neverthe¬ 
less the fact that it can be organised into a universal machine still 
remains interesting . 161 

As a search for ‘teaching policies’ Turing’s experiments with P-types were 
not a great success. The method he used to train the P-type with external 
memory required considerable intelligence on the part of the trainer and 
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he described it as ‘perhaps a little disappointing', remarking that ‘[i]t is not 
sufficiently analogous to the kind of process by which a child would really be 
taught’. 163 


Artificial Life 

In his final years Turing worked on (what since 1987 is called) Artificial Life 
(A-Life). The central aim of A-Life is a theoretical understanding of naturally 
occurring biological life—in particular of the most conspicuous feature of 
living matter, its ability to self-organize (i.e. to develop form and structure 
spontaneously). A-Life characteristically makes use of computers to simulate 
living and life-like systems. Langton, who coined the term Artificial Life', 
wrote 


Computers should be thought of as an important laboratory tool for 
the study of life, substituting for the array of incubators, culture 
dishes, microscopes, electrophoretic gels, pipettes, centrifuges, and 
other assorted wet-lab paraphernalia, one simple-to-master piece of 
experimental equipment . 161 

Turing was the first to use computer simulation to investigate a theory 
of ‘morphogenesis’—the development of organization and pattern in living 
things. 165 He began this investigation as soon as the first Ferranti Mark I to be 
produced was installed at Manchester University. He wrote in February 1951: 

Our new machine is to start arriving on Monday. I am hoping as one of 
the first jobs to do something about ‘chemical embryology’. In partic¬ 
ular I think one can account for the appearance of Fibonacci numbers 
in connection with fir-cones . 166 

Shortly before the Ferranti computer arrived, Turing wrote about his work 
on morphogenesis in a letter to the biologist J. Z. Young. 167 The letter con¬ 
nects Turing’s work on morphogenesis with his interest in neural networks, 
and to some extent explains why he did not follow up his suggestion in ‘Intel¬ 
ligent Machinery’ and use the Ferranti computer to simulate his unorganized 
machines. 

I am afraid I am very far from the stage where I feel inclined to start 
asking any anatomical questions [about the brain]. According to my 
notions of how to set about it that will not occur until quite a late 
stage when I have a fairly definite theory about how things are done. 
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At present I am not working on the problem at all, but on my 
mathematical theory of embryology ... This is yielding to treatment, 
and it will so far as I can see, give satisfactory explanations of - 

i) Gastrulation. 

ii) Polyogonally symmetrical structures, e.g., starfish, flowers. 

iii) Leaf arrangement, in particular the way the Fibonacci series 
(O, I, I, 2, 3, 5, 8,13, ...) comes to be involved. 

iv) Colour patterns on animals, e.g., stripes, spots and dappling. 

v) Patterns on nearly spherical structures such as some Radiolaria, 
but this is more difficult and doubtful. 

I am really doing this now because it is yielding more easily to treat¬ 
ment. I think it is not altogether unconnected with the other problem. 
The brain structure has to be one which can be achieved by the 
genetical embryological mechanism, and I hope that this theory that 
I am now working on may make clearer what restrictions this really 
implies. What you tell me about growth of neurons under stimulation 
is very interesting in this connection. It suggests means by which the 
neurons might be made to grow so as to form a particular circuit, 
rather than to reach a particular place. 


In June 1954, while in the midst of this groundbreaking work, Turing died. 
He left a large pile of handwritten notes concerning morphogenesis, and 
some programs. 168 This material is still not fully understood. 
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